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Abstract 

Lenses — bidirectional transformations between pairs of connected 
structures — have been extensively studied and are beginning to find 
their way into industrial practice. However, some aspects of their 
foundations remain poorly understood. In particular, most previous 
work has focused on the special case of asymmetric lenses, where 
one of the structures is taken as primary and the other is thought of 
as a projection, or view. A few studies have considered symmetric 
variants, where each structure contains information not present in 
the other, but these all lack the basic operation of composition. 
Moreover, while many domain- specific languages based on lenses 
have been designed, lenses have not been thoroughly explored from 
an algebraic perspective. 

We offer two contributions to the theory of lenses. First, we 
present a new symmetric formulation, based on complements, an 
old idea from the database literature. This formulation generalizes 
the familiar structure of asymmetric lenses, and it admits a good 
notion of composition. Second, we explore the algebraic structure 
of the space of symmetric lenses. We present generalizations of a 
number of known constructions on asymmetric lenses and settle 
some longstanding questions about their properties — in particular, 
we prove the existence of (symmetric monoidal) tensor products 
and sums and the «6>«-existence of full categorical products or sums 
in the category of symmetric lenses. We then show how the meth- 
ods of universal algebra can be applied to build iterator lenses for 
structured data such as lists and trees, yielding lenses for operations 
like mapping, filtering, and concatenation from first principles. Fi- 
nally, we investigate an even more general technique for construct- 
ing mapping combinators, based on the theory of containers. 

Categories and Subject Descriptors D.3.2 [Programming Lan- 
guages]: Language Classifications — Specialized application lan- 
guages 

General Terms Design, Languages, Theory 
Keywords lens, view-update, algebra, category theory 

1. Introduction 

The electronic world is rife with partially synchronized data — 
replicated structures that are not identical but share some common 
parts, and where the shared parts need to be kept up to date as the 
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structures change. Examples include databases and materialized 
views, in-memory and on-disk representations of heap structures, 
connected components of user interfaces, and models representing 
different aspects of the same software system. 

In current practice, the propagation of changes between con- 
nected structures is mostly handled by ad hoc methods. Given a 
pair of structures X and Y, we write one transformation that maps 
changes to X into changes to Y and a separate transformation that 
maps Y changes to X changes. However, when the structures in- 
volved are complex, managing such pairs of transformations man- 
ually can be a maintenance nightmare. 

This has led to a burgeoning interest in bidirectional program- 
ming languages, in which every expression denotes a related pair 
of transformations. A great variety of bidirectional languages have 
been proposed (see [8, 13] for recent surveys), and these ideas are 
beginning to see commercial application, e.g., in RedHat's system 
administration tool, Augeas [21]. 

One particularly well-studied class of bidirectional program- 
ming languages is the framework of lenses [11]. Prior work on 
lenses and lens-like structures has mostly been carried out in spe- 
cific domains — designing combinators for lenses that work over 
strings [5, 7, 12], trees [11, 17, 20, 25], relations [6], graphs [16], 
or software models [9, 10, 15, 26, 27, 31]. By contrast, our aim in 
this paper is to advance the foundations of lenses in two significant 
respects. 

First, we show that lenses can be generalized from their usual 
asymmetric presentation — where one of the structures is always a 
"view" of the other — to a fully symmetric version where each of 
the two structures may contain information that is not present in 
the other (Section 2). This generalization is significantly more ex- 
pressive than any previously known: although symmetric variants 
of lenses have been studied [10, 23, 28], they all lack a notion of 
sequential composition of lenses, a significant technical and prac- 
tical limitation (see Section 10). As we will see, the extra struc- 
ture that we need to support composition is nontrivial; in particular, 
constructions involving symmetric lenses need to be proved correct 
modulo a notion of behavioral equivalence (Section 3). 

Second, we undertake a systematic investigation of the alge- 
braic structure of the space of lenses, using the concepts of ele- 
mentary category theory as guiding and organizing principles. (Our 
presentation is self contained, but some prior familiarity with basic 
concepts of category theory will be helpful. Most proofs are omit- 
ted for brevity; they can be found in a long version of the paper, 
available from the second author's web page.) 

We begin this algebraic investigation with some simple generic 
constructions on symmetric lenses: composition, dualization, ter- 
minal lenses, simple bijections, etc. (Section 4). We then settle 
some basic questions about products and sums (Sections 5 and 6). 
In particular, it was previously known that asymmetric lenses ad- 
mit constructions intuitively corresponding to pairing and projec- 
tion [7] and another construction that is intuitively like a sum [11]. 
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However, these constructions were not very well understood; in 
particular, it was not known whether the pairing and projection 
operations formed a full categorical product, while the injection 
arrows from X to X + Y and from Y to X + Y were not defin- 
able at all in the asymmetric setting. We prove that the category of 
symmetric lenses does not have full categorical products or sums, 
but does have "symmetric monoidal" structures with many of the 
useful properties of products and sums. 

Next, we consider how to build lenses over more complex 
data structures such as lists and trees (Section 7). We first ob- 
serve that the standard construction of algebraic datatypes can be 
lifted straightforwardly from the category of sets to the category 
of lenses. For example, from the definition of lists as the least so- 
lution of the equation L(X) c± Unit + X x L(X) we obtain a 
lens connecting the set L(X) with the set Unit + X x L(X); 
the two directions of this lens correspond to the unfold and fold 
operations on lists. Moreover, the familiar notion of initial algebra 
also generalizes to lenses, giving us powerful iterators that allow 
for a modular definition of many symmetric lenses on lists and 
trees — e.g., mapping a symmetric lens over a list, filtering, revers- 
ing, concatenating, and translating between lists and trees. 

Finally, we briefly investigate an even more general technique 
for constructing "mapping lenses" that apply the action of a given 
sublens to all the elements of some data structure (Section 8). This 
technique applies not only to algebraic data structures but to an ar- 
bitrary container in the sense of Abbot, Altenkirch, and Ghani [2]. 
This extends the variety of list and tree mapping combinators that 
we can construct from first principles to include non-inductive 
datatypes such as labeled dags and graphs. 

We carry out these investigations in the richer space of symmet- 
ric lenses, but many of the results and techniques should also apply 
to the special case of asymmetric lenses. Indeed, we can show (Sec- 
tion 9) that asymmetric lenses form a subcategory of symmetric 
ones in a natural way: every asymmetric lens can be embedded in 
a symmetric lens, and many of the algebraic operators on symmet- 
ric lenses specialize to known constructions on asymmetric lenses. 
Conversely, a symmetric lens can be factored into a "back to back" 
assembly of two asymmetric ones. 

Sections 10 and 11 discuss related and future work. 

2. Fundamental Definitions 

Asymmetric Lenses To set the stage, let's review the standard def- 
inition of asymmetric lenses. (Other definitions can be given, fea- 
turing weaker or stronger laws, but this version is widely accepted. 
We discuss variants in Section 10.) Suppose X is some set of source 
structures (say, the possible states of a database) and Y a set of tar- 
get structures (views of the database). An asymmetric lens from X 
to Y has two components: 

get £ X ->« Y 
put e Y x X X 

The get component is the forward transformation, a total function 
from X to Y . The put component takes an old X and a modified Y 
and yields a correspondingly modified X. These components must 
obey two "round-tripping" laws for every xGl and y <EY: 



put (get x) x — x 
get (put y x) — y 



(GetPut) 
(PutGet) 



It is also useful to be able to create an element of x given just an 
element of y, with no "original x" to put it into; in order to handle 
this in a uniform way, each lens is also equipped with a function 
create £ Y — »• X, and we assume one more axiom: 



Complements The key step toward symmetric lenses is the no- 
tion of complements. The idea dates back to a famous paper in the 
database literature on the view update problem [4] and was adapted 
to lenses in [5] (and, for a slightly different definition, [22]), and 
it is quite simple. If we think of the get component of a lens as 
a sort of projection function, then we can find another projection 
from X into some set C that keeps all the information discarded by 
get. Equivalently, we can think of get as returning two results — an 
element of Y and an element of C — that together contain all the 
information needed to reconstitute the original element of X. Now 
the put function doesn't need a whole x £ X to recombine with 
some updated y £ Y; it can just take the complement c £ C gen- 
erated from x by the get, since this will contain all the information 
that is missing from y. Moreover, instead of a separate create func- 
tion, we can simply pick a distinguished element missing £ C and 
define create(y) as put(y, missing). 

Formally, an asymmetric lens with complement mapping be- 
tween X and Y consists of a set C, a distinguished element 
missing £ C, and two functions 



get 
put 



£ 
£ 



X ^Y xC 
Y xC X 



obeying the following laws for every x £ X, y £ Y, and c £ C: 1 

get x = (y, c) 



put (y, c) — x 
get (put (y,c)) (b',c') 

b' = y 



(GetPut) 



(PutGet) 



Note that the type is just "lens from X to Y": the set C is an internal 
component, not part of the externally visible type. In symbols, 

Lens(X, Y) — 3C. {missing : C, get : X — >• Y x C, put : 
Y xC X}. 



Symmetric Lenses Now we can symmetrize. First, instead of hav- 
ing only get return a complement, we make put return a comple- 
ment too, and we take this complement as a second argument to 
get. So we have get £ X x Cy — » Y x Cx and put £ Y x Cx — > 
X x Cy - Intuitively, Cx is the "information from X that is dis- 
carded by get? and Cy is the "information from Y that is discarded 
by putr Next we observe that we can, without loss of generality, 
use the same set C as the complement in both directions. So now 
we have geteXxC^YxC and put eYxC^XxC. Intu- 
itively, we can think of the combined complement C as Cx x Cy — 
that is, each complement contains some "private information from 
X" and some "private information from Y" ; by convention, the get 
function reads the Cy part and writes the Cx part, while the put 
reads the Cx part and writes the Cy part. Lastly, now that every- 
thing is symmetric, the get I put distinction is not helpful, so we 
rename the functions to putr and putl. This brings us to our core 
definition. 

2.1 Definition [Symmetric lens]: A lens £ from X to Y (written 
£ £ X Y) has three parts: a set of complements C, a distin- 
guished element missing £ C, and two functions 

putr £ X x C ^ Y x C 
putl £ Y x C ^ X x C 

satisfying the following round- tripping laws: 



get (create y) — y 



(CreateGet) 



1 We can convert back and forth between the two presentations; in particular, 
if (get, put, create) are the components of a traditional lens, then we de- 
fine a canonical complement by C = {f £ Y— >X \ My. get(f(y)) = y}. 
We then define the components missing' , get' , and put' of an asym- 
metric lens with complement as missing' = create and get' (x) = 
(get(x),Xy.put(y,x)) <mdput'(y,f) = f(y). 



2 



2011/1/31 



Schubert, 


1797-1828 




Schubert, 


Austria 


Shumann, 


1810-1856 




Shumann, 


Germany 



dates only here countries only here 

(a) Initial replicas 
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add an extra structure (the "complement") that 
stores the "private Information" from both sides 

(b) Initial complement 
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(c) One replica edited 



1797-1828 


Austria 




1797-1828 


Austria 


1810-1856 


Germany 




1810-1856 


Germany 


1567-1643 


?country? 




1567-1643 


Pcountry? 



SpJinhprt 17Q7-rtR?R 

Schubert, 1797-1828 
Shumann, 18L0-1856 
Monteverdi, 1/567-1643 



each transformation propagates 
updates both to the target artifact 
and to the complement... 




Schubert, Austria 
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...using the complement 
to fill in information not 
available in the source 



(d) Propagating the edit 
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(e) Second replica is edited 
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(f) This change is propagated 



Figure 1. Behavior of a symmetric lens 



putr(x, c) — (y, c) 
putl(y, c') — (x, c') 

putl(y, c) = (x, c) 
putr(x, c) — (y, c) 



(PutRL) 



(PutLR) 



When several lenses are under discussion, we use record notation 
to identify their parts, writing i.C for the complement set of i, etc. 

The force of the PutRL and PutLR laws is to establish some 
"consistent" or "steady-state" triples (x, y, c), for which puts of x 
from the left or y from the right will have no effect — that is, will not 
change the complement. The conclusion of each rule has the same 
variable c on both sides of the equation to reflect this. We will use 
the equation putr(x, c) = (y, c) to characterize the steady states. 
In general, a put of a new x from the left entails finding a y and a 
c that restore consistency. Additionally, we often wish this process 
to involve the complement c from the previous steady state; as a 
result, it can be delicate to choose a good value of missing. This 
value can often be chosen compositionally; each of our primitive 
lenses and lens combinators specify one good choice for missing. 

One can imagine other laws. In particular, the long version of 
the paper considers symmetric forms of the asymmetric "PutPut" 
laws, which specify that two put operations in a row should have 
the same effect as the second one alone. As with asymmetric lenses, 
these laws appear too strong to be desirable in practice. 

Examples Figure 1 illustrates the use of a symmetric lens. The 
structures in this example are lists of textual records describing 
composers. The partially synchronized records (a) have a name and 
two dates on the left and a name and a country on the right. The 
complement (b) contains all the information that is discarded by 
both puts — all the dates from the left-hand structure and all the 
countries from the right-hand structure. (It can be viewed as a pair 
of lists of strings, or equivalently as a list of pairs of strings; the 
way we build list lenses later actually corresponds to the latter.) If 
we add a new record to the left hand structure (c) and use the putr 
operation to propagate it through the lens (d), we copy the shared 
information (the new name) directly from left to right, store the 
private information (the new dates) in the complement, and use a 
default string to fill in both the private information on the right and 
the corresponding right-hand part of the complement. If we now 
update the right-hand structure to fill in the missing information and 
correct a typo in one of the other names (e), then a putl operation 



will propagate the edited country to the complement, propagate 
the edited name to the other structure, and use the complement to 
restore the dates for all three composers. 

Viewed more abstractly, the connection between the informa- 
tion about a single composer in the two tables is a lens from 1x7 
to Y x Z, with complement X x Z — let's call this lens e. Its putr 
component is given (x, y) as input and has (x' , z) in its comple- 
ment; it constructs a new complement by replacing x by x to form 
(x, z), and it constructs its output by pairing the y from its input 
and the z from its complement to form (y, z). The putl component 
does the opposite, replacing the z part of the complement and re- 
trieving the x part. Then the top-level lens in Figure 1 — let's call it 
e* — abstractly has type (1x7)* o (Y xZ)* and can be thought 
of as the "lifting" of e from elements to lists. 

There are several plausible implementations of e*, with slightly 
different behaviors when list elements are added and removed — 
i.e., when the input and complement arguments to putr or putl are 
lists of different lengths. One possibility is to take e*.C = (e.C)* 
and maintain the invariant that the complement list in the output is 
the same length as the input list. When the lists in the input have 
different lengths, we can restore the invariant by either truncating 
the complement list or padding it with e. missing. For example, 
taking X = {a, b, c, . . .}, Y = {1, 2, 3, . . .}, Z = {A, B,C,.. .}, 
and e. missing = (m, M), and writing (a, b, c) for the sequence 
with the three elements a, b, and c, we could have: 



putr(((a,l)), ((p,P),(q,Q))) 
putr(((a,l)), ((p,P)» 
«(1^)>, ((a,P)» 

jm*r(((M), (M)> , ((a,P))) 
putr(((a,l),(b,2)), ((a,P),(m,M))) 
«(1,P),(2,M)>, <(a,P),(6,M)» 



(truncating) 



(padding) 



Notice that, after the first putr, the information in the second 
element of the complement list (q,Q) is lost. The second putr 
creates a brand new second element for the list, so the value Q 
is gone forever; what's left is the default value M. 

Another possibility — arguably better behaved — is to keep an 
infinite list of complements. Whenever we do a put, we use (and 
update) a prefix of the complement list of the same length as the 
current value being put, but we keep the infinite tail so that, later, 
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we have values to use when the list being put is longer. 

putr({(a, 1)> , ((p, P), (q, Q), (ro, M), (m, M), . . .}) 
= (((1, P)> , ((a, P), (q, Q), (m, M), (m, M), . . .» 

putr({(a, 1), (6, 2)} , {(a, P), (<j, Q), (ro, M), (m, M), . . .)) 
= (((1, P), (2, Q)> , {(a, P), (b, Q), (ro, M), . . .}) 

We call the first form the forgetful list mapping lens and the 
second the retentive list mapping lens. We will see, later, that the 
difference between these two precisely boils down to a difference 
in the behavior of the lens- summing operator © in the specification 
e* c± id unit © (e®e*) of the list mapping lens. 

Figure 2 illustrates another use of symmetric lenses. The struc- 
tures in this example are lists of categorized data; each name on the 
left is either a composer (tagged inl) or an author (tagged inr), 
and each name on the right is either a composer or an actor. The 
lens under consideration will synchronize just the composers be- 
tween the two lists, leaving the authors untouched on the left and 
the actors untouched on the right. The synchronized state (a) shows 
a complement with two lists, each with holes for the composers. If 
we re-order the right-hand structure (b), the change in order will be 
reflected on the left by swapping the two composers. Adding an- 
other composer on the left (c) involves adding a new hole to each 
complement; on the left, the location of the hole is determined by 
the new list, and on the right it simply shows up at the end. Simi- 
larly, if we remove a composer (d), the final hole on the other side 
disappears. 

Abstractly, to achieve this behavior we need to define a lens 
comp between (X-\-Y)* and (X-\-Z)*. To do this, it is convenient 
to first define a lens that connects (X + Y)* and X* x Y*\ call 
this lens partition. The complement of the partition is a list of 
booleans telling whether the corresponding element of the left list 
is an X or a Y. The putr function is fairly simple: we separate the 
(X+Y) list into X and Y lists by checking the tag of each element, 
and set the complement to exactly match the tags. For example: 

putr((\n\ a, inl 6, inr 1) , c) = (((a, b) , (1)), (false, false, true)) 
putr((\n\ a, inr 1, inl b) , c) = (((a, b) , (1)), (false, true, false)) 

These examples demonstrate that putr ignores the complement 
entirely, fabricating a completely new one from its input. The putl 
function, on the other hand, relies entirely on the complement for its 
ordering information. When there are extra entries (not accounted 
for by the complement), it adds them at the end. Consider taking 
the output of the second putr above and adding c to the X list and 
2 to the Y list: 

putl(((a, b, c) , (1, 2)), (false, true, false)) = 
((inl a, inr 1, inl b, inl c, inr 2) , 
(false, true, false, false, true)) 

The putl fills in as much of the beginning of the list as it can, using 
the complement to indicate whether to draw elements from X* or 
from Y*. (How the remaining X and Y elements are interleaved 
is a free choice, not specified by the lens laws, since this case only 
arises when we are not in a round-tripping situation. The strategy 
shown here, where all new X entries precede all new Y entries, is 
just one possibility.) 

Given partition, we can obtain comp by composing three 
lenses in sequence: from (X + Y)* we get to X* x Y* using 
partition, then to X* x Z* using a variant of the lens e discussed 
above, and finally to (X + Z)* using a "backwards" partition. 

Alignment One important non-godX of the present paper is deal- 
ing with the (important) issue of alignment [5, 7]. We consider only 
the simple case of lenses that work "positionally." For example, the 
lens e* in the example will always use e to propagate changes be- 
tween the first element of x and the first element of y, between the 



second element of x and the second of y, and so on. This amounts 
to assuming that the lists are edited either by editing individual el- 
ements in place or by adding or deleting elements at the end of 
the list; if an actual edit inserts an element at the head of one of 
the lists, positional alignment will produce surprising (and proba- 
bly distressing) results. We see two avenues for incorporating richer 
notions of alignment: either we can generalize the mechanisms of 
matching lenses [5] to the setting of symmetric lenses, or we can 
refine the whole framework of symmetric lenses with a notion of 
delta propagation; see Section 11. 

3. Equivalence 

Since each lens carries its own complement — and since this need 
not be the same as the complement of another lens with the same 
domain and codomain — we now need to define what it means for 
two lenses to be indistinguishable, in the sense that no user could 
ever tell the difference between them by observing just the X and Y 
parts of their outputs. We will use this relation pervasively in what 
follows: indeed, most of the laws we would like our constructions 
to validate — even things as basic as associativity of composition — 
will not hold "on the nose," but only up to equivalence. 

3.1 Definition: Given X, Y, C/, C 9 and a relation R C Cf x C 9 , 
we say that functions / G X xCf —> Y xCf and g G X x C g — » 
Y x C g are R-similar, written / ~r g, if they take inputs with R- 
related complements to equal outputs with i?-related complements: 

(c f ,c g ) e R f 
f(x,c f ) = (yf,c'f) 
g(x,c g ) (y g ,c g ) 

Vf =Vg A (c'f,c' g ) e R 

3.2 Definition [Lens equivalence]: Two lenses k and £ are equiv- 
alent (written k = £) if there is a relation R £ k.C x t.C with 

1. (k. mis sing ,£. mis sing) £ R 

2. k.putr ~r i.putr 

3. k.putl ~r i.putl. 



We write X 



Y for the set of equivalence classes of lenses 



from X to Y. When £ is a lens, we write [£] for the equivalence 
class of £ (that is, £ e X Y iff [£] e X Y). Where no 
confusion results, we abuse notation and drop these brackets, using 
£ for both a lens and its equivalence class. 

We show in the long version that this definition of lens equiva- 
lence coincides with a more "observational" definition where two 
lenses are equivalent iff they always give the same sequence of out- 
puts when presented with the same sequence of inputs, starting with 
a missing complement. 

4. Basic Constructions 

With the basic definitions in hand, we can start defining lenses. We 
begin in this section with several relatively simple constructions. 

4.1 Definition [Identity lens]: Let Unit be a distinguished single- 
ton set and () its only element. 



id x e X <H> X 



C 

missing 
putr(x, ()) 
putl(x, ()) 



Unit 

o 

(*,()) 
(*,()) 
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(a) Initial replicas 



(b) Alphabetizing the right 
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(c) Inserting Chopin on the left 



inr (Kerouac ) 
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inr (Tolstoy ) 
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inr (Kerouac ) 
inl (Chopin) 
inr (Tolstoy ) 
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inl(?) 
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inl ( Chopin ) 
inr (Clooney ) 
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(d) Deleting Beethoven from the left 



Figure 2. Synchronizing lists of sums 



To check that this definition is well formed, we must show that 
the components defined in the lower box satisfy the round-trip laws 
implied by the upper box. This proof and analogous ones for later 
lens definitions are given in full in the long version. 

4.2 Definition [Lens composition]: 



keX £eY z 

k\t i X o z 



c 

missing 

putr(x, (ck,ce)) 



putl(z,(c k ,c £ )) = 



k.C x £.C 

(k. missing, £. missing) 

let (y, c k ) — k.putr(x, Ck) in 

let (z, c £ ) = £.putr(y, c £ ) in 

let (y, c'i) — £.putl(z, c £ ) in 
let (x, c k ) — k.putl(y, Ck) in 

(x, (C fc , C £ )) 



This definition specifies what it means to compose two lenses. 
To show that this definition lifts to equivalence classes of lenses, 
we need to check the following congruence property. We include 
the proof to give a taste of the technique; proofs of similar lemmas 
for the other operators on lenses defined below are deferred to the 
long version. 

4.3 Lemma [Composition preserves equivalence]: If k = k' and 

£ = £! Atenk-^^k'^ . 

4.4 Definition: The following function on relations is convenient 
here: 

RiX R 2 = {((ci,c 2 ), (ci,c 2 )) | (ci,ci) e Ri A (c2,c' 2 ) G R 2 } 

Proof of 4.3: If the simulation R k witnesses k = k' and Ri 
witnesses £ = £' then it is straightforward to verify that R = 
Rk x Ri witnesses k\£ = k']£'. There are three things to show. 



1. We wish to show the first line: 

(k;£). missing R (k' ']£') .missing 
<^=^> (k. missing, £. missing) R (k' .missing, £' .missing) 
<^=^> k. missing Rk k' .missing A £. missing Ri £' .missing 

But the final line is certainly true, since Rk and Re are simula- 
tion relations. 

2. We must show that (k;£).putr ~r (k 1 ';£'). putr. So take 
Cfc,Q,Cfc/,Q/ such that (ck,ci) R (cfc/,Q/) and choose an 
input x. Define the following: 

(y,Ck) = k.putr(x,c k ) 
(z,c £ ) = £.putr(y,c £ ) 
(y,c k t) = k'.putr(x,c k >) 
(z',c' £ ,) = £' '.putr(y \c#) 
We can then compute: 

(k]£).putr(x,(c k ,Ci)) = (z,(c k ,c £ )) 
(k';£').putr(x,(c kf ,c ef )) = {z',(c k ,,c e )) 

We need to show that z — z and that (c k ,c £ ) R (c k ,,c t ,). 
Since c k R k c k > , we can conclude that y — y and c' k R k c k , ; 
similarly, since eg Ri c £ > and y = y\ we know that z — z 
(discharging one of our two proof burdens) and c' £ Ri c t ,. 
Combining the above facts, we find that (c k , c' £ ) R (c' k ,, c' £f ) 
by definition of R (discharging the other proof burden). 

3. The proof that (k;£).putl ~r (k' ']£'). putl is similar to the 
putr case. □ 

4.5 Lemma [Associativity of composition]: j; (k; £) = (j; k);£. 
(The equivalence is crucial here: j; (k; £) and (j; k); £ are not the 
same lens because their complements are structured differently.) 

4.6 Lemma [Identity arrows]: The identity lens is a left and right 
identity for composition: idx]£ = £\ idy = £■ 

Thus symmetric lenses form a category, LENS, with sets as 
objects and equivalence classes of lenses as arrows. The identity 
arrow for a set X is [idx]. Composition is [k] ; [£] = [k; £]. 
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4.7 Proposition [Bijective lenses]: 

/ 

/ bijective 

bijf 



C = Unit 

missing — () 

putr(x,Q) = (/(x),()) 

P uti(y,0) = (r\y),0) 



(If we were designing syntax for a bidirectional language, we might 
not want to include bij, since we would then need to offer pro- 
grammers some notation for writing down bijections in such a way 
that we can verify that they are bijections and derive their inverses. 
However, even if it doesn't appear in the surface syntax, we will 
see several places where bij is useful in talking about the algebraic 
theory of symmetric lenses.) 

This transformation (and several others we will see) respects 
much of the structure available in our category. Formally, bij is a 
functor. Recall that a covariant (respectively, contravariant) func- 
tor between categories C and V is a pair of maps — one from objects 
of C to objects of V and the other from arrows of C to arrows of 
V — that preserve typing, identities, and composition: 

• The image of any arrow / : X —> Y in C has the type F(f) : 
F(X) F(Y) (respectively, F(f) : F(Y) F{X)) in V. 

• For every object X in C, we have F(idx) = id>F(x) m 

• If f-g = h in C, then F(f);F(g) = F(h) (respectively, 
F(g);F(f) = F(h))mV. 

Covariant functors are simply called functors. When it can be 
inferred from the arrow mapping, the object mapping is often 
elided. 

4.8 Lemma: The bij operator forms a functor from the category 
ISO, whose objects are sets and whose arrows are isomorphic func- 
tions, to LENS — that is, bijid x — idx and bijf, bij g — bijf- g . 

4.9 Definition [Dual of a lens]: 

lex 

£°p £ Y ^ X 



C = £.C 

missing = £. missing 

putr(y,c) — £.putl(y,c) 

putl(x,c) — £.putr(x, c) 



It is easy to see that {-) op is involutive— that is, that (£ op ) op = 
£ for every £ — and that bijf-i — biff for any bijective /. Re- 
calling that an endofunctor is a functor whose source and target 
categories are identical, we can easily show the following lemma. 

4.10 Lemma: The (— ) op operation can be lifted to a contravariant 
endofunctor on the category LENS, mapping each arrow [£] to [£ op ]. 

4.11 Corollary: The category LENS is self dual, i.e., equivalent to 
its own opposite. (Note that this does not mean that each arrow is 
its own inverse!) 

Proof: The arrow part of (— ) op is bijective. □ 

The lenses we have discussed so far maintain all the information 
in the domain and codomain. It is sometimes useful to discard some 
information in one direction of the lens. The terminal lens does this, 
recording the discarded information in the complement so that the 
other direction of the lens can restore it. 



4.12 Definition [Terminal lens]: 

/ 

x e x 

term x Glf> Unit 

- 

' 

C = X 

missing — x 

putr(x',c) — (0,x) 

putl((),c) = (c,c) 



4.13 Proposition [Uniqueness of terminal lens]: Lenses with the 
same type as a terminal lens are equivalent to a terminal lens. More 
precisely, suppose k £ X Unit and k.putl((),k. missing) — 
(x,c). Then k = term x . 

Of course, there may be many (pairwise non-equivalent) termi- 
nal lenses of a particular type; for any two x, y £ X with x ^ y, 
it's clear that term x ^= term y . Proposition 4.13 tells us that there 
are exactly as many arrows £ : X Unit as there are elements 
ofX. 

4.14 Definition [Disconnect lens]: 



x e X 


yeY 


disconnect X y 






disconnect X y — 


term x ; term° y p 



The disconnect lens does not synchronize its two sides at all. The 
complement, disconnect. C, is X x Y\ inputs are squirreled away 
into one side of the complement, and outputs are retrieved from the 
other side of the complement. 

5. Products 

A few additional notions from elementary category theory will be 
useful for giving us ideas about what sorts of properties to look for 
and for structuring the discussion of which of these properties hold 
and which fail for lenses. 

The categorical product of two objects X and Y is an object 
X x Y and arrows m : X x Y —> X and 7r 2 : X x Y —> Y 
such that for any two arrows / : Z — >• X and g : Z — >• Y there is 
a unique arrow {f,g):Z^Xx Y — the pairing of / and g — 
satisfying (/, g);iri — f and (/, g) ; 7T2 = g. It is well known that, 
if a categorical product exists at all, it is unique up to isomorphism. 
If a category C has a product for each pair of objects, we say that C 
has products. 

5.1 Theorem: LENS does not have products. 

Proof idea: Suppose we have lenses k £ Z <^=> X and £ £ 
Z Y. Informally, the lens k includes a way to take any Z 

and choose a corresponding X and a way to take any X and find a 
corresponding Z. Many common categories with products include 
the former, but the latter is somewhat unique to lens categories, so 
we focus on the return trip here. 

The lenses k and £ together mean we have a way to take any 
X and choose a corresponding Z, and we have a (separate) way to 
take any Y and choose a corresponding Z. Assume temporarily 
that the object part of the product of two objects is simply the 
Cartesian product. To complete the product, we must construct 
(k,£) £ Z <^> X x Y, that is, we must find a way to take an X 
and a Y and choose a Z that corresponds to both simultaneously. 
But there may not be any such Z — the Z that k gives us from X 
may not be the same as the Z that £ gives us from Y. 
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To complete the proof, we simply choose X and Y carefully to 
rule out the possibility of a corresponding Z, regardless of whether 
we choose X x Y to be the Cartesian product or to be some other 
construction. 

Proof: Uniqueness of pairing shows that there is exactly one lens 
from Unit to Unit x Unit (whatever this may be). Combined with 
Prop. 4.13 this shows that Unit x Unit is a one-element set. Again 
by Prop. 4.13 this then means that lenses between Unit x Unit 
and any other set X are constant which leads to cardinality clashes 
once \X\ > 1. (A more detailed proof appears in the full paper.) □ 

However, LENS does have a similar (but weaker) structure: a 
tensor product — i.e., an associative, two-argument functor. For any 
two objects X and Y, we have an object and for any two 

arrows / : A —> X and g : B — ► Y, an arrow f ® g : A ® B —> 
X 0 Y such that (/i;/ 2 ) 0 (<?i;# 2 ) = (fi 0 gi); (/ 2 0 g 2 ) 
and idx 0 idy = idx®y- Furthermore, for any three objects 
X, y, Z there is a natural isomorphism ax,y,z '■ (X 0 Y) 0 Z — »• 
X® (Y®Z) satisfying certain coherence conditions (which specify 
that all ways of re- associating a quadruple are equal). 

A categorical product is always a tensor product (by defining 
/ 0 g = (tti; /, 7T2; g)), and conversely a tensor product is a 
categorical product if there are natural transformations 7Ti , 7T2 , cfaap 



such that (suppressing subscripts to reduce clutter) 





7ri;/ 


fi) 


(/® g);7t2 


= vr 2 ;^ 


(2) 


diag;(f®f) 


= /; 


(3) 


diag; tti 


= 


(4) 


diag; 712 


= 


(5) 


diag; (m 0 7T2) 


= id 


(6) 



for all arrows / and g. Building a categorical product from a tensor 
product is not the most familiar presentation, but it can be shown to 
be equivalent (see Proposition 13 in [3], for example). 

In the category LENS, we can build a tensor product and can 
also build projection lenses with reasonable behaviors. However, 
these projections are not quite natural transformations — laws 1 
and 2 above hold only with an additional indexing constraint for 
particular / and g. More seriously, while it seems we can define 
some reasonable natural transformations with the type of diag (that 
is, arrows satisfying law 3), none of them satisfy the final three 
laws. 

5.2 Definition [Tensor product lens]: 



kex ^ z ieY 

k®£eXxY^ZxW 



C 

missing 

putr((x,y), (c k ,ci)) 



putl((z,w),(ck,Cf>)) = 



k.C x LC 

(k. missing, £. missing) 

let (z,c k ) — k.putr(x, c k ) in 

let (w, c' £ ) — £.putr(y, q) in 

((z,w),(c' k ,c' £ )) 

let (x, c k ) — k.putl(z, Cfc) in 

let (y, c'g) — £.putl(w, ci) in 

((x,y), (4,4)) 



5.3 Lemma [Product bijection]: For bijections / and g, 

bijf 0 bijg = bijf X g. 

In fact, the particular tensor product defined above is very well 
behaved: it induces a symmetric monoidal category — i.e., a cate- 
gory with a unit object 1 and the following natural isomorphisms: 

: (X 0 Y) 0 Z -> X 0 (Y 0 Z) 
: X®1^ X 



ctx,y,z 



Ax : 
px : 

Jx,y : 

These are known as the associator, left-unitor, right-unitor, and 
symmetry, respectively. In addition to the equations implied by 
these being natural isomorphisms, they must also satisfy some 
coherence conditions (given in the full version). 

5.4 Proposition [LENS,0 is a symmetric monoidal category]: 

In the category SET, the Cartesian product is a bifunctor with 
Unit as unit, and gives rise to a symmetric monoidal category. Let 
a x ,A x ,p x ,7 x be associator, left-unitor, right-unitor, and sym- 
metry natural isomorphisms. Then the 0 bifunctor also gives rise 
to a symmetric monoidal category of lenses, with Unit as unit and 
a 0 = bijoa x , A 0 = bijo A x , p® = bijop x , <mdj® = bijoj x 
as associator, left-unitor, right-unitor, and symmetry, respectively. 

Knowing that LENS is a symmetric monoidal category is useful 
for several reasons. First, it tells us that, even though it is not 
quite a full-blown product, the tensor construction is algebraically 
quite well behaved. Second, it justifies a convenient intuition where 
lenses built from multiple tensors are pictured as graphical "wiring 
diagrams," and suggests a possible syntax for lenses that shuffle 
product components (which we briefly discuss in Section 11). 

5.5 Definition [Projection lenses]: In LENS, the projection is 
parametrized by an extra element to return when executing a putl 
with a missing complement. 



yeY 



my e x x Y <h> x 




The verification that this forms a lens is straightforward. 



The other projection is defined similarly. 

Returning to the example in the introduction, recall that we wish 
to create a lens e : X xY <H> Y x Z with missing elements m £ X 
and M £ Z. We now have the machinery necessary to construct 
this lens: 

op 

e = 7l 2 m ; 7T 1M 

The extra parameter to the projection (e.g. m or M above) 
needs to be chosen with some care. Some sets may have clear 
neutral elements; for example, a projection from A x B* — >• A will 
likely use the empty list () as its neutral element. Other projections 
may need additional domain knowledge to choose a good neutral 
element — for example, a projection A x Country — ► A might use 
the country with the most customers as its default. 

In some cases, the algebraic laws that one wants the projection 
to satisfy may guide the choice as well. The extra parameter pre- 
vents full naturality from holding, and therefore prevents this from 
being a categorical product, but the following "indexed" version of 
the naturality law does hold. 

5.6 Lemma [Naturality of projections]: Suppose k G X k Y k 
and £ £ Xg Yg and choose some initial value yi £ Yg. Define 

(xi, Ci) — £. putl (yi,£. mis sing). Then (k 0 £); 7Ti yi = 7Vi Xi ; k. 



7 



2011/1/31 



The most serious problem, though, is that there is no diagonal. 
There are, of course, lenses with the type we need for diag — for 
example, disconnect. Or, more usefully, the lens that coalesces 
the copies of X whenever possible, preferring the left one when 
it cannot coalesce (this is essentially the merge lens from [11]) 



diag Gl-^IxI 



C 

missing 
putr(x, inl ()) 
putr(x, inr x') 
putl((x, x'), c) 



Unit + X 
inl () 

((x,x),ml ()) 
((x, x'), eq(x, x')) 
(x, eq(x, x')) 



where here the eq function tests its arguments for equality — 
eq{x,x') yields inl () if x — x and yields x if not. However, 
neither of these proposals satisfy all the required laws. 

6. Sums and Lists 

The status of sums has been even more mysterious than that of 
products. In particular, the injection arrows from A to A + B and 
B to A + B do not even make sense in the asymmetric setting; as 
functions, they are not surjective, so they cannot satisfy PutGet. 

A categorical sum of two objects X and Y is an object X + Y 
and arrows inl : X — > X + Y and inr : Y —> X + Y such that 
for any two arrows / : X —> Z and g : Y — ► Z there is a unique 
arrow [f,g] : X + Y — > Z — the choice of / or g — satisfying 
inl; [f,g] = f and inr; [f,g] — g. As with products, if a sum 
exists, it is unique up to isomorphism. 

Since products and sums are dual, Corollary 4.11 and Theo- 
rem 5.1 imply that LENS does not have sums. But we do have a 
tensor whose object part is a set-theoretic sum — in fact, there are at 
least two interestingly different ones — and we can define useful as- 
sociated structures, including a choice operation on lenses. As with 
products, a tensor can be extended to a sum by providing injec- 
tion and co-diagonal natural transformations satisfying a family of 
equations, but these constructions are even farther away from being 
categorical sums than what we saw with products. 

The two tensors, which we called retentive and forgetful in 
Section 2, differ in how they handle the complement when the 
new value being put is from a different branch of the sum than 
the old value that was put. The retentive sum keeps complements 
for both sublenses in its own complement and switches between 
them as needed. The forgetful sum keeps only one complement, 
corresponding to whichever branch was last put. If the next put 
switches sides, the complement is replaced with missing. We give 
just the retentive sum here, since it seems more useful; the forgetful 
sum can be found in the long version. 

6.1 Definition [Retentive tensor sum lens]: 



kex ^ z ieY 

ke£eX + Y z + w 



C 

missing — 

putr(\n\ x,(ck,ce)) = 

putr(\m y,(ck,Ci)) = 

putl(\n\ z, (cfc, ce)) = 

putl(\nr w,(ck,ce)) = 



k.C x £.C 

(k. missing, £. missing) 

let (z,c f k ) — k.putr(x, Ck) in 

(inl z, (4, ce)) 

let (w, c'i) — £.putr(y, ce) in 

(inr w, (c fc ,ci)) 

let (x, c' k ) — k.putl(z, Cfc) in 

(inl x, (c' k , a)) 

let (y, c e ) = £.putl(y, ce) in 

(inr y, (c k ,c' e )) 



6.2 Lemma [Sum bijection]: For bijections / and g, 

bijf 0 bij g = bijf+g 

6.3 Proposition [lens,0 is a symmetric monoidal category]: 

In SET, the disjoint union gives rise to a symmetric monoidal cate- 
gory with 0 as unit. Let ce + , A + , 7 + be associator, left-unitor, 
right-unitor, and symmetry natural isomorphisms. Then the © bi- 
functor gives rise to a symmetric monoidal category of lenses with 
0 as unit and ce e = bijo ce + , A® = bij o A + , p® — bijo p + , and 
-y® = bijo^ + as associator, left-unitor, right-unitor, and symmetry, 
respectively. 

The types of these natural isomorphisms are: 



a 



X,Y,Z 

A? 

1X,Y 



e {X + Y) + Z^X + (Y + Z) 

e 0 + x^x 

e x + 0^x 

e x +y ^y +x 



Unlike the product unit, there are no interesting lenses whose 
domain is the sum's unit, so this cannot be used to define the 
injection lenses; we have to do it by hand. 

6.4 Definition [Injection lenses]: 



xex 



c 

missing 

putr(x, (x' , inl ())) 
putr(x, {x' , inr y)) 
putl(\x\\ x, c) 
putl(\nr y, (x, c)) 



X x ( Unit + Y) 
(x,inl ()) 
(inl x, (x, inl ())) 
(inr y, {x, inr y)) 
(x, (x,inl ())) 
(x, (x,inry)) 



We also define inr y = inl y ; 7® x . 

6.5 Proposition: The injection lenses are not natural. 

As with products, where we have a useful lens of type X 
X x X that is nevertheless not a diagonal lens, we can craft a 
useful conditional lens of type X + X <H> X that is nevertheless not 
a codiagonal lens. In fact, we define a more general lens union £ 
X + Y X UY. Occasionally, a value that is both an X and a 
Y may be put to the left across one of these union lenses. In this 
situation, the lens may legitimately choose either an inr tag or an inl 
tag. The union lens uses the most recent unambiguous put to break 
the tie. (In the long version, we also define a variant that looks back 
to the last tagged value that was put to the right that was in both 
sets.) 

6.6 Definition [Union lens]: 



unionxY Gl + F^IUF 



C 



= Bool 

— false 

= (x, false) 

= (2/,true) 



missing 
putr(\n\ x, c) 
putr(\nr y, c) 
putl(xy, c) 

(inl xy, false) xy ^Y V (xy GlA ->c) 
(inr xy, true) xy £ X V (xy £ Y A c) 



This definition is not symmetric in X and Y, because putl 
prefers to return an inl value if there have been no tie breakers yet. 
Because of this preference, union cannot be used to construct a 
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true codiagonal. However, there are two useful related construc- 
tions: 

6.7 Definition [Switch lens]: 



switchx Gl + I^I 



switch x — union xx 



6.8 Definition [Retentive case lens]: 



kex ^ z ieY z 

casek,i £ X + Y -<->• Z 



casek,e — (k 0 £); switchx 



A forgetful case lens appears in the long version. 

Lists We can also define a variety of lenses operating on lists. We 
only consider mapping here, because in the next section we show 
how to obtain this and a whole variety of other functions on lists as 
instances of a powerful generic theorem, but it is useful to see one 
concrete instance first! 

Write X* for the set of lists with elements from the set X. Write 
() for the empty list and x:xs for the list with head x and tail xs. 
Write X^ for the set of infinite lists over X. When x £ X and 
ss £ X u , write x\ss £ for the infinite list with head x and tail 
ss. Write x u £ X w for the infinite list of x's. 

6.9 Definition [Retentive list mapping lens]: 



£ex ^Y 



map(£) e X* ^Y" 



C 

missing 
putr(x, c) 



\0J 



putl 



(tcy 

(£. missing) 1 
let (xi, . . . , Xm) — x in 
let (ci, . . .) = c in 
let (i/i, c-) = £.putr(xi, a) in 

1 • • • 1 Urn) 1 (Ci, . . . , C m , C m 

(similar) 



As we saw in Section 2, there is also a forgetful variant of the list 
mapping lens. Indeed, this is the one that corresponds to the known 
list mapping operator on asymmetric lenses [7, 11]. Additionally, 
the map lens gives us the machinery we need to complete the first 
example in the introduction: simply define e* = map(e). 

7. Iterators 

In functional programming, mapping functionals are usually seen 
as instances of more general "fold patterns," or defined by general 
recursion. In this section, we investigate to what extent this path 
can be followed in the world of symmetric lenses. 

Allowing general recursive definitions for symmetric lenses 
may be possible, but in general, complements change when un- 
folding a recursive definition; this means that the structure of the 
complement of the recursively defined function would itself have 
to be given by some kind of fixpoint construction. Preliminary in- 
vestigation suggests that this is possible, but it would considerably 
clutter the development — on top of the general inconvenience of 
having to deal with partiality. 

Therefore, we choose a different path. We identify a "fold" 
combinator for lists, reminiscent of the view of lists as initial 
algebras. We show that several important lenses on lists — including 



mapping — can be defined with the help of a fold, and that, due 
to the self-duality of lenses, folds can be composed back-to-back 
to yield general recursive patterns in the style of hylomorphisms 
[24]. We also discuss iteration patterns on trees and argue that the 
methodology carries over to other polynomial inductive datatypes. 

7.1 Lists 

Let fold £ Unit + (XxX*) — > X* be the bijection between 
"unfolded" lists and lists; fold takes inl () to () and inr (x, xs) to 
x\xs. Note that bijfoid £ Unit + (XxX*) X* is then a 

bijective arrow in the category LENS. 

7.1.1 Definition: An X-list algebra on a set Z is an arrow £ £ 
Unit + (XxZ) Z and a function w £ Z -> N such that 
£.putl(z,c) — (inr (x,z'),c) implies w(z') < w(z). We write 
T x for the functor that sends any lens k to id unit © (idx © k). 

The function w here plays the role of a termination measure. 
We will be iterating £.putl, producing a stream of values of type Z, 
which we would like to guarantee eventually ends. 

7.1.2 Theorem: For X-list algebra £ on Z, there is a unique arrow 
It(£) £ X* <^=> Z such that the following diagram commutes: 

* / ^ bijfoid 
T X (X*) >X* 



T x (It(£)) 

T X (Z) 



It(£) 



£ 



■* Z 



Proof sketch: We choose the complement of It(£) to be £.C U , so 
that the complements of the two arms of the commuting square 
are isomorphic. We then take commutativity of the diagram as a 
suggestion for a recursive definition of both putr and putl. The 
length of the list in the case of putr and the weight function in the 
case of putl are used as ranking functions establishing totality of 
the recursive definitions. One must then prove, again by induction 
on these ranking functions, that the square does indeed commute. 

To show uniqueness, we take another lens k which satisfies the 
above commutativity diagram. The diagram induces an "unfold- 
ing" of k's complement into an infinite sequence of complements 
that satisfy a pairwise correspondence property with the infinite se- 
quence in It(£) 9 s complement. We can then show that putr and 
putl preserve this correspondence, which lets us construct a rela- 
tion witnessing the equivalence of k and It(£). □ 

In the terminology of universal algebra, an algebra for a functor F 
from some category to itself is simply an object Z and an arrow 
F(Z) — > Z. An arrow between F-algebras (Z, /) and (Z f , / ; ) is 
an arrow u £ Z —> Z' such that /; u — F(u)\f. The F-algebras 
thus form a category themselves. An initial F-algebra is an initial 
object in that category (an initial object has exactly one arrow to 
each other object, and is unique up to isomorphism). F-algebras 
can be used to model a wide variety of inductive datatypes, includ- 
ing lists and various kinds of trees [29]. Using this terminology, 
Theorem 7.1.2 says that bijfoid is an initial object in the subcate- 
gory consisting of those T x -algebras for which a weight function 
w is available. 

Let us consider some concrete instances of the theorem. First, if 
k £ X Y is a lens, then we can form an X-list algebra £ on 
Y* by composing id unit © (k 0 idy*) £ Unit + (1x7*) 
Unit + (YxY*) with bij fo i d £ Unit + (YxY*) Y*. 
A suitable weight function is given by w(ys) = length(ys). 
The induced lens It(£) £ X* Y* is the lens analog of 

the familiar list mapping function. In fact, substituting the lens 
e £ X x Y Y x Z (from the introduction) for k in the 
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above diagram, we find that It (£) is the sneakier variant of the lens 
e*. (Again, we are ignoring the important question of alignment 
here. A hand- written map lens could perform a more sophisticated 
alignment analysis to associate "similar" items in a sequence of 
puts and recover more appropriate data from the complement; the 
process described above results in a simple positional alignment 
scheme.) 

Second, suppose that X = X\ + X 2 and let Z be X* x X 2 . 
Writing X+ forX* x X*, we can define isomorphisms 
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(X 1 + X 2 ) x XI x X\ 

[xt + xt) + {xt x xt + xt x xt) 

Unit + {(Xt + Xt) + X x + x X 2 + ) 
Xt x X 2 * 



by distributing the sum and unfolding the list type for / and by 
factoring the polynomial and folding the list type for g. Then we 
can create 



£ e Unit + ((Xi + X 2 ) x Z) +± Z 



£ = (id unit 0 bijf); 
(id umt © (id 
bij g 



X + +X + 



switch v + v Y +))\ 



A suitable weight function for £ is given by w((xs\,xs 2 )) — 
length(xsi) + length(xs 2 ). The lens It(£) £ (Xi + X 2 )* 
X* x X2 that we obtain from iteration partitions the input list in 
one direction and uses a stream of booleans from the state to put 
them back in the right order in the other direction. Indeed, It(£) is 
exactly the partition lens described in the introductory examples. 
Composing it with a projection yields a filter lens. (Alternatively, 
the filter lens could be obtained directly by iterating a slightly 
trickier £.) Consequently, we now have the machinery we need to 
define comp from the introduction: 

filter — partition; ttiq 

comp — filter; filter op 

7.1.3 Corollary: Suppose k op is an X-list algebra on W and £ is 
an X-list algebra on Z. Then there is a lens Hy(k, £) £ W Z 
such that the following diagram commutes: 



(W) 



k 



W 



T x (Hy(k,£)) 



Ti(Z) 



Hy(k,£) 



£ 



■» Z 



Proof: 



Define Hy(k, £) as the composition It(k op ) op ; It(£). □ 

One can think of Hy(k, £) as a recursive definition of a lens. The 
lens k tells whether a recursive call should be made, and if so, 
produces the argument for the recursive call and some auxiliary 
data. The lens £ then describes how the result is to be built from 
the result of the recursive call and the auxiliary data. This gives 
us a lens version of the hylomorphism pattern from functional 
programming [24]. Unfortunately, we were unable to prove or 
disprove the uniqueness of Hy(k, £). 

We have not formally studied the question of whether It(£) is 
actually an initial algebra, i.e., whether it can be defined and is 
unique even in the absence of a weight function. However, this 
seems unlikely, because then it would apply to the case where Z 
is the set of finite and infinite X lists and £ the obvious bijective 
lens. The putl component of It(£) would then have to truncate an 
infinite list, which would presumably break the commuting square. 



7.2 Other Datatypes 

Analogs of Theorem 7.1.2 and Corollary 7.1.3 are available for a 
number of other functors, in particular those that are built up from 
variables by + and x . All of these can also be construed as con- 
tainers (see Section 8), but the iterator and hylomorphism patterns 
provide more powerful operations for the construction of lenses 
than the mapping operation available for general containers. More- 
over, the universal property of the iterator provides a modular proof 
method, allowing one to deduce equational laws which can be cum- 
bersome to establish directly because of the definition of equality as 
behavioral equivalence. For instance, we can immediately deduce 
that list mapping is a functor. Containers, on the other hand, sub- 
sume datatypes such as labeled graphs that are not initial algebras. 

Iterators with multiple arguments The list iterator allows us to 
define a lens between X* and some other set Z, but Theorem 7.1.2 
cannot be directly used to define a lens between X* x Y and 
Z (think of Y as modeling parameters). In standard functional 
programming, a map from X* x Y to Z is tantamount to a map 
from X* to Y—>Z, so iteration with parameters is subsumed by 
the parameterless case. Unfortunately, LENS does not seem to have 
the function spaces required to play this trick. 

Therefore, we introduce the functor T XY (Z) = Y + X x Z 
and notice that T£ y (X* x Y) ~ X* x Y. Just as before, an 
algebra for that functor is a lens £ £ T XjY (Z) Z together with 
a function w : Z —> N such that £.putl(z, c) — (inr (x, z), c) 
implies w(z') < w(z). 

As an example, let Y = Z = X* and define 



c 

missing 

£.putr(\n\ xs, b) 
£.putr(\nr (x, xs), b) 

£.putl({) ,b) 
£.putl(x:xs, true) 
£.putl(x:xs, false) 



Bool 
true 

(xs, true) 
(x:xs, false) 

(inl () , true) 
(inl (x:xs), true) 
(inr (x, xs), false) 



Iteration yields a lens X* x X* <H> X* that can be seen as a 
bidirectional version of list concatenation. The commuting square 
for the iterator corresponds to the familiar recursive definition 
of concatenation: concat({) ,ys) — ys and concat(x\xs,ys) — 
x\concat(xs,ys). In the bidirectional case considered here the 
complement will automatically retain enough information to allow 
splitting in the ]?^/-direction. 

We can use a version of Corollary 7.1.3 for this data structure to 
implement tail recursive constructions. Consider, for instance, the 
T Unit ,x* -algebra k : X* + X* x X* X* x X* where 

k.putl((acc, ()),true) = (inl acc, true) 
k.putl((acc, x:xs), true) = (inr (x\acc, xs), true) 
k.putl((acc, xs), false) = (inr (acc, xs), false). 

Together with the T UnitjX * -algebra switchx* ■ X* + X* <-> X*, 
this furnishes a bidirectional version of the familiar tail recursive 
list reversal that sends (acc, xs) to xs rev acc. 

Trees For set X let Tree(X) be the set of binary X-labeled 
trees given inductively by leaf £ Tree(X) and x £ X, £ £ 
Tree(X),r £ Tree(X) ^> node(x,£,r) £ Tree(X). Con- 
sider the endofunctor T^ ree (Z) = Unit + X x Z x Z. Let c £ 
Tx ree ( Tree(X)) <-> Tree(X) denote the obvious bijective lens. 

An X-tree algebra is a lens £ £ T x ee (Z) <H> Z and a 
function w £ Z — >• N with the property that if £.putl(z,c) — 
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(inr (x, zi, z r ), c) then w(zi) < w(z) and w(z r ) < w(z). The 
bijective lens c is then the initial object in the category of X-tree 
algebras; that is, every X-tree algebra on Z defines a unique lens 
in Tree(X) <-> Z. 

Consider, for example, the concatenation lens concat : X* x 
X* <-> X\ Let concat' : Unit + X x X* x X* <-> X* be 
the lens obtained from concat by precomposing with the fold- 
isomorphism and the terminal lens temiQ. Intuitively, this lens 
sends inl () to () and x, xs, xs' to x:xs@xs', using the complement 
to undo this operation properly. This lens forms an example of a 
tree algebra (with number of nodes as weight functions) and thus 
iteration furnishes a lens Tree(X) <H> X* which does a pre-order 
traversal, keeping enough information in the complement to rebuild 
a tree from a modified traversal. 

The hylomorphism pattern can also be applied to trees, yielding 
the ability to define symmetric lenses by divide-and-conquer, i.e., 
by dispatching one call to two parallel recursive calls whose results 
are then appropriately merged. 



BUM' < i) 
B(i A %') ^—^ B{i) 



8. Containers 

The previous section suggests a construction for a variety of oper- 
ations on datatypes built from polynomial functors. Narrowing the 
focus to the very common "map" operation, we can generalize still 
further, to any kind of container functor [1], i.e. a normal functor 
in the terminology of Hasegawa [14] or an analytic functor in the 
terminology of Joyal [19]. (These structures are also related to the 
shapely types of Jay and Cockett [18].) 



8.1 Definition [Container]: A container consists of a set I to- 
gether with an /-indexed family of sets B £ / — >• Set. 

Each container (/, B) gives rise to an endofunctor Fi,b on SET 
whose object part is defined by Fi,b (X) = ^ W ~* X. For 

example, if / = N and B{n) — {0, 1, ... , n— 1}, then F^b(X) 
is X* (up to isomorphism). Or, if / = Tree(Unit) is the set of 
binary trees with trivial labels and B(i) is the set of nodes of i, 
then Fi,b (X) is the set of binary trees labeled with elements of X. 
In general, we can think of / as a set of shapes and, for each shape 
i £ /, we can think of B(i) as the set of "positions" in shape i. So 
an element (z, /) £ Fi^b(X) consists of a shape i and a function 
/ assigning an element f(p) £ X to each position p £ B(i). The 
arrow part of Fi b maps a function u £ X — »• Y to a function 
F ItB (u) £ F ItB (X) -+ Fj, B (Y) given by (ij) ^ (ij;u). 

Now, we would like to find a way to view a container as a 
functor on the category of lenses. In order to do this, we need a 
little extra structure. 



8.2 Definition: A container with ordered shapes is a pair (/, B) 
satisfying these conditions: 

1. / is a partial order with binary meets. We say i is a subshape of 
j whenever i < j. 

2. B is a functor from (J, <) viewed as a category (with one 
object for each element and an arrow from i to j iff i < j) 
into SET. When B and i are understood, we simply write b\i' 
for B(i < i')(b) if b £ B(i) andi < i'. 

3. If z and % are both subshapes of a common shape j and we 
have positions b £ B(z) and b'^B(i') with &|j = b'\j, then 
there must be a unique bo^B(iAi') such that 6 = 6o|i and 

= bo\i' . Thus such 6 and b' are really the same position. In 
other words, every diagram of the following form is a pullback: 



B(iM' < i') 

B(i') 



B{i! < 3) 



B(i < j) 
B(j) 



If i < j, we can apply the instance of the pullback diagram 
where i — % and hence i A i' — i and deduce that B(i < j) £ 
B(i) —> B(j) is always injective. 

For example, in the case of trees, we can define t < t! if every 
path from the root in t is also a path from the root in t' . The arrow 
part of B then embeds positions of a smaller tree canonically into 
positions of a bigger tree. The meet of two trees is the greatest 
common subtree starting from the root. 

8.3 Definition [Container mapping lens]: 



i £ X <-> Y 



F^bW e F IjB (X) F ItB (Y) 



c = 

{teUiei B ^^UC) I 
VM'- i<i' D VbeB(i). t(i')(b\i') = t(i)(b)} 
missing (i)(b) — £. missing 

let /'(b)' = fst{£. putr{f(b),t(i)(b))) in 

\ett'(j)(b) = 

if 3b 0 € B(i A j). bo\j = b 

then snd(£. putr(f(bo\i),t(j)(b))) in 

elset(j)(6) 

((*,/')> O 
put/ (similar) 



(Experts will note that C is the limit of the contravariant functor 
i (B(i) —> £.(C)). Alternatively, we can construe C as the 
function space D — > L(C) where D is the colimit of the functor 
B. Concretely, D is given by m °dulo the equivalence 

relation ~ generated by (z, b) ~ (i*' whenever i < % and 
6 ; = B(i < z0(6).) 

For the case of lists, this mapping lens coincides with the reten- 
tive map that we obtained from the iterator in Section 7. In general, 
two pieces of data synchronized by one of these mapping lenses 
will have exactly the same shape; any shape change to one of the 
sides will be precisely mirrored in the other side. For example, the 
tree version of this lens will transport the deletion of a node by 
deleting the node in the same position on the other side. We believe 
it should also be possible to define a forgetful version where the 
complement is just F^b(£-C). 

9. Asymmetric Lenses as Symmetric Lenses 

The final step in our investigation is to formalize the connection 
between symmetric lenses and the more familiar asymmetric ones, 
and to show how known constructions on asymmetric lenses corre- 
spond to the constructions we have considered. 

Write X A Y for the set of asymmetric lenses from X to Y 
(using the first presentation of asymmetric lenses from Section 2, 
with get, put, and create components). 

9.1 Definition: Every asymmetric lens can be embedded in a sym- 
metric one. 
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£ e x A y 

£sym e X <r+ Y 

C = {feY^X\VyeY. £.get(f(y)) = y} 

missing — £. create 

putr(x,f) = (Lget(x),f x ) 

putl(y,f) = let x = f(y) in (x,f x ) 



(Here, f x (y) means £.put(y, x).) Viewing X as the source of an 
asymmetric lens (and therefore as having "more information" than 
Y), we can understand the definition of the complement here as 
being a value from X stored as a closure over that value. The 
presentation is complicated slightly by the need to accommodate 
the situation where a complete X does not yet exist — i.e. when 
defining missing — in which case we can use create to fabricate an 
X value out of a Y value if necessary. 

9.2 Definition [Asymmetric lenses]: Here are several useful asym- 
metric lenses, based on string lenses from [7]. (We give only their 
names and types here; full definitions appear in the long version.) 
We use £x,y to stand for any asymmetric lens £ G X A Y . 



copy x 


e 


x A x 


£x,y;£y,z 


e 


x A z 


aconst x 


e 


X A Unit whenever x£l 


£x,Y ' £z,W 


e 


X x Z & Y xW 


£x,y\£z,w 


e 


x+z Ay uw 




e 


x* Ay* 



9.3 Theorem: The symmetric embeddings of these lenses corre- 
spond nicely to definitions from earlier in this paper: 



sym 

copyx 


= idx 


fi) 


(k-£) sym 




(2) 


,sym 

aconst x 


= term x 


(3) 


(k-£) sym 


= k sym 0 £ sym 


(4) 


(k\£) sym 


= (k syrn 0^* £ sym ); union 


(5) 




= mapf (£ sym ) 


(6) 



The first two show that (— ) sym is a functor. The (B operator is the 
forgetful variant of 0; see the long version for the full definition. 

We suspect that there might be an asymmetric fold construction 
similar to our iteration lens above satisfying an equivalence like 

fold(£) sym = It(t ym ), 

but have not explored this carefully. 

The (— ) sym functor is not full — that is, there are some symmet- 
ric lenses which are not the image of any asymmetric lens. Injection 
lenses, for example, have no analog in the category of asymmetric 
lenses, nor do either of the example lenses presented in the intro- 
duction. However, we can characterize symmetric lenses in terms 
of asymmetric ones in a slightly more elaborate way. 

9.4 Theorem: Given any arrow £ of LENS, there are asymmetric 
lenses k u k 2 such that (k sy m ) op ; k sym = L 

To see this, we need to know how to "asymmetrize" a symmetric 
lens. We can view a symmetric lens as a pair of asymmetric lenses 
joined "tail to tail" whose common domain is consistent triples. For 
any lens £ G X <-> Y, define Si = {(x,y,c) G X x Y x LC 
£.putr(x, c) = (y, c)}. Now define: 
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£ex ^Y 

C sym e S e A x 

' ' 

get((x,y,c)) = x 

put{x' , (x,y,c)) — let (y' , c) — £.putr(x, c) 

in (x',y',c f ) 

create(x) — let (y,c) — £.putr(x,£. mis sing) 

in {x,y,c) 

The definition of t^™ e S £ A Y is similar. 

Proof of 9.4: Given [£} , choose ki = £ a r sym and k 2 = t^™ ■ □ 

10. Related Work 

There is a large literature on lenses and related approaches to 
propagating updates between connected structures. We discuss only 
the most closely related work here; good general surveys of the area 
can be found in [8, 13]. Connections to the literature on view update 
in databases are surveyed in [11]. 

The first symmetric approach to update propagation was pro- 
posed by Meertens [23] and followed up by Stevens [26], Diskin [10], 
and Xiong, et al [30]. 

Meertens suggests modeling synchronization between two sets 
X and y by a consistency relation R C X xY and two consistency 
maintainers < : X x Y — >• X and > : X x Y — >• Y such that 
(x < y) R y and x R (x > y) always hold, and such that x R y 
implies x < y — x and x\>y = y. 

The main advantage of symmetric lenses over consistency 
maintainers is their closure under composition. Indeed, all of the 
aforementioned authors note that, in general, consistency main- 
tainers do not compose and view this as a drawback. Suppose that 
we have relations R C X x Y and R' C Y x Z maintained by 
>, < and > ; , resp. If we want to construct a maintainer for the 
composition R; R\ we face the problem that, given x G X and 
z G Z, there is no canonical way of coming up with a y £ Y 
that will allow us to use either of the existing maintainer functions. 
Concretely, Meertens gives the following counterexample. Let X 
be the set of nonempty context free grammars over some alpha- 
bet, and let Y be the set of words over that same alphabet. Let 
R C X x Y be given by G R x x e L(G). It is easy 

to define computable maintainer functions making this relation a 
constraint maintainer. Composing this relation with its opposite 
yields an undecidable relation (namely, whether the intersection 
of two context-free grammars is nonempty), so there cannot be 
computable maintainer functions. 

We can transform any constraint maintainer into a symmetric 
lens as follows: take the relation R itself (viewed as a set of pairs) as 
the complement, and define putl(x\ (x,y)) — {x'>y, (x\x>y)) 
and similarly for putr. If we compose such a symmetric lens with 
its opposite we obtain RxR op as the complement and, for example, 
putr(x, (2/2, £2))) = (x2<(x>yi), ((x , x'>yi), (x f > 

yi,X2<(x'>yi)))). For Meertens' counterexample, we would have 
complements of the form ((6a, w\ ), (w%, G2)), with w\ £ L(Gi) 
and W2 G £(£2); "putr"-mg a new grammar G[ through the com- 
posed lens yields the complement ((Gi,w[), (w[ , 6r 2 )), where w[ 
is wi if wi G L(Gi) and some default otherwise, and where 
G' 2 — G2 if w[ G L(G2 ) and S^w[ (where S is the start state) 
otherwise. We observe that there is a property of lenses analogous 
to Meertens' requirement that x Ry implies x < y = x. This prop- 
erty is not necessarily preserved by composition, and in particular 
the lens described above for synchronizing languages does not have 
it. Meertens recommends using a chain of consistency maintainers 
in such a situation to achieve a similar effect; however, the proper- 
ties of such chains have not been explored. 
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For asymmetric lenses, a number of alternative laws have been 
explored. Some of these are weaker than ours; for example, a 
number of papers from a community of researchers based in Tokyo 
replace the PutGet law with a somewhat looser PutGetPut 
law, permitting a broader range of useful behaviors for lenses that 
duplicate information. It would be interesting to see what kind 
of categorical structures arise from these choices. The proposal 
by Matsuda et al.[22] is particularly interesting because it also 
employs the idea of complements. Conversely, stronger laws can be 
imagined, such as the PutPut law discussed by Foster et al. [11]. 

A different foundation for defining lenses by recursion was 
explored by Foster et al. [11], using standard tools from domain 
theory to define monotonicity and continuity for lens combinators 
parametrized on other lenses. The main drawback of this approach 
is that the required (manual) proofs that such recursive lenses are 
total tend to be somewhat intricate. By contrast, we expect that our 
initial- algebra approach can be equipped with automatic proofs of 
totality (that is, choices of the weight function w) in many cases of 
interest. 

11. Conclusions and Future Work 

We have proposed the first notion of symmetric bidirectional trans- 
formations that supports composition. Composability opens up the 
study of symmetric bidirectional transformations from a category- 
theoretic perspective. We have explored the category of symmetric 
lenses, which is self-dual and has the category of bijections and that 
of asymmetric lenses each as full subcategories. We have surveyed 
the structure of this category and found it to admit tensor product 
structures that are the Cartesian product and disjoint union on ob- 
jects. We have also investigated datatypes both inductively and as 
"containers" and found the category of symmetric lenses to support 
powerful mapping and folding constructs. 

Syntax Although we have focused here on semantic and alge- 
braic foundations, many of our constructions have a straightfor- 
ward syntactic realization. In particular, it is easy to give a string- 
transformation interpretation to all the constructions in Sections 4 
to 6 (including lenses over lists); these could easily be used to build 
a symmetric version of Boomerang [7]. More interesting would be 
to eliminate Boomerang's built-in lists and instead obtain lenses 
over lists and other structures (mapping, reversing, flattening of 
lists, transforming trees into lists) solely by using the combinators 
derived from the category-theoretic structure we have exhibited. To 
accomplish this, two further fine points need to be considered. First, 
we would want an automatic way for discovering weight functions 
for iterators. We believe that a straightforward termination analysis 
based on unfolding (similar to the one built into Coq) could help, 
but the details remain to be checked. And second, we must invent 
a formal syntax for programming with containers. Surprisingly, the 
existing literature does not seem to contain such a proposal. 

More speculatively, it is a well-known folklore result that sym- 
metric monoidal categories are in 1-1 correspondence with wiring 
diagrams and with first-order linear lambda calculus. We would 
like to exploit this correspondence to design a lambda-calculus- 
like syntax for symmetric lenses and perhaps also a diagrammatic 
language. The linear lambda calculus has judgments of the form 
xi:Ai, . . . , Xn\A n h t : Ao, where Ao, . . . , A n are sets or possi- 
bly syntactic type expressions and where t is a linear term made up 
from basic lenses, lens combinators, and the variables X\ 5 ... , Xf% . 
This could be taken as denoting a symmetric lens A± 0 • • • 0 A n <H> 
Ao. For example, here is such a term for the lens concat' from Sec- 
tion 7.2: 

z: Unit © A 0 A* <g) A* h match z with 

inl () i— )• term°j 

inr (a,al,ar) \— > concat (a:al, ar) 



The interpretation of such a term in the category of lenses then takes 
care of the appropriate insertion of bijective lenses for regrouping 
and swapping tensor products. 

Complements as States One benefit of treating complements ex- 
plicitly is that it opens the way to a stateful presentation of lenses. 
The idea is that the complement of a lens can be thought of as its lo- 
cal storage — the part of the heap that belongs to it. An obvious next 
step is that, instead of the lens components taking the local storage 
as an argument and returning an updated version as a result, they 
can just hang onto it themselves, internally, in mutable variables. 
The types of the put operations then become just i.putr £ A —> B 
and i.putl £ B —> A, where the — > is now a "programming lan- 
guage function type," with the usual implicit treatment of the heap. 
This avoids destructing the given C each time we propagate an up- 
date and rebuilding a new C to yield as a result, improving the ef- 
ficiency of the implementation. An additional improvement comes 
from the next potential extension. 

Alignment and Delta Lenses As we mentioned in Section 2, 
dealing correctly with alignment of structured information is cru- 
cial in practice. This issue has been extensively explored in the 
context of asymmetric lenses, and it seems it should be possible 
to adapt existing ideas such as dictionary lenses [7] and matching 
lenses [5] to symmetric lenses. An even better approach might be to 
change the fundamental nature of lenses so that, instead of working 
directly with entire structures, they work with deltas — descriptions 
of changes to the structures. These deltas can arise from simple po- 
sitional judgments, as in this paper, from diff-like heuristics, from 
cues within the data itself, or perhaps even from user interaction — 
the lens itself doesn't need to know anything about this. 

Many of our basic constructions can be adapted to deltas by 
taking the domain and codomain of a lens to be monoids (of edit 
operations) instead of sets, and then, for each lens construction, 
defining an appropriate edit monoid from the monoids of its com- 
ponents. For example, an edit for a pair lens is a pair of edits for the 
left- and right-hand sides of the pair. However, more thought is re- 
quired to make this scheme really work: applying this idea naively 
leads to insufficiently expressive edit languages for structures like 
lists. In particular, we would like to see insertion and deletion as 
edit operations on lists (and rotations and the like for trees, etc.). 
Currently, we believe that containers are a promising framework 
for this endeavour. 

Algebraic Structure We have shown that the category of symmet- 
ric lenses does not have products or sums. One reviewer suggests 
that it may be interesting to explore placing a partial order on the 
the homsets of our category (the sets of arrows between pairs of ob- 
jects). Perhaps this extra structure would allow us to define variants 
of products and sums in which the required equations do not hold 
as equalities, but as inequalities. 
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